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Abstract  -  This  paper  describes  the  benefits  of 
transmission  subspace  tracking  for  multiple  input  multiple 
output  communications  systems,  and  applies  the  concepts  of 
previous  work  on  adaptive  transmit  antenna  algorithms  to 
this  problem.  A  specific  stochastic  gradient  technique  of 
subspace  or  “multi-mode”  tracking  of  the  independent 
modes  of  the  MIMO  transfer  function  and  the  application  to 
space  time  coding  is  considered.  The  technique  provides 
gains  by  tracking  the  active  modes  when  there  are  more 
transmit  than  receive  antennas.  With  the  proposed 
algorithm,  the  receiver  generates  binary  feedback  selecting 
preferred  perturbed  weights,  which  gives  the  transmitter  a 
gradient  estimate  useful  for  subspace  tracking.  The  capacity 
resulting  from  this  approach  is  shown  by  simulation. 

1.  Introduction 

In  recent  years  there  have  been  advances  in  multiple-input 
multiple-output  (MIMO)  communications  systems,  specifically 
the  concept  of  “space  time  coding”  (STC)  for  wireless 
communications  [5][6][11].  The  STC  algorithms  use  the 
independent  modes  of  the  MIMO  transfer  function  to 
effectively  attain  multiple  parallel  transmission  pipes,  giving  an 
increase  in  the  effective  available  transmission  bandwidth  and 
allowing  for  greater  transmission  bit  rates.  The  optimal 
transmission  algorithm  uses  a  “water  filling”  power/rate 
allocation  strategy  [12]  into  these  non-zero  modes.  In  frequency 
division  duplex  systems  only  the  receiving  unit  can  measure  the 
channel  transfer  function,  and  hence  feedback  is  required  to 
provide  this  information  to  the  transmitting  unit  and  the 
complexity  of  water  filling  may  be  prohibitive.  This  paper 
describes  an  algorithm  for  tracking  the  principal  non-zero 
modes  of  the  transfer  function  utilizing  feedback,  without  the 
additional  complexity  of  doing  power/rate  allocation  into  those 
modes. 

Tracking  of  the  principal  modes  provides  benefit  when  some 
of  the  available  transmission  subspaees  have  null  or  near  null 
response  and  hence  deliver  no  power  to  the  receiver.  This 
condition  will  arise  if  the  channel  response  is  ill-conditioned 
due  to  a  poor  scattering  environment,  as  can  occur  even  with 
fading  independent  across  all  antennas  [7],  or  if  the  number  of 
receive  antennas  is  less  than  the  number  of  transmit  antennas 
due  to  cost  or  size  constraints.  The  specific  algorithm  proposed 
is  a  subspace  tracking  variation  on  the  algorithm  previously 
analyzed  in  [1][2],  which  is  a  single  receive  antenna  subset  of 
the  algorithm  described  in  the  present  paper. 

There  is  a  substantial  body  of  literature  on  the  subject  of 
signal  processing  approaches  for  transmit  adaptation  in 
multiple-input  single-output  (M1SO)  environments  and  for 
subspaee  tracking  in  the  context  of  receive  systems,  examples 
being  [2][9]  and  [  1 0][  13][14]  respectively.  The  focus  of  this 
paper  is  a  signal  processing  approach  to  tracking  the  transfer 
function  principal  subspaee,  without  consideration  of  the  coding 
techniques  applied  once  those  modes  are  determined  Any  of  a 
number  of  standard  coding  techniques  can  be  applied,  and  the 


MIMO  transfer  function  modes  can  be  utilized  the  same  as  any 
time/frequency  modes  are  used  for  traditional  coding. 

The  algorithm  uses  feedback  to  provide  the  transmitter  with  a 
coarse  estimate  of  the  gradient  of  the  power  delivered  to  the 
receiver  with  respect  to  the  transmission  weight  vectors. 
Gaussian  perturbation  probing  is  applied  to  the  weight  vectors 
of  the  pilots  of  each  space  time  coded  transmission  stream  such 
that  the  receiver  can  select  a  preferred  perturbed  weight  vector 
set  and  simultaneously  extract  a  channel  estimate  for  each  code 
stream.  Feedback  is  generated  to  select  the  preferred  weight  set, 
which  provides  the  transmitting  unit  with  the  coarse  gradient 
estimate  used  to  update  the  weights.  Gram-Schmidt 
orthonormalization  is  performed  to  maintain  the  orthonormality 
of  the  applied  weight  set.  The  first  order  behavior  of  this 
approach  is  very  similar  to  that  of  [14]. 

Simulations  with  2  receive  and  4  or  8  transmit  antennas  in  a 
fading  environment  show  the  effectiveness  of  this  tracking 
algorithm  in  attaining  the  potential  gain  over  blind  MIMO 
transmission,  and  capacities  for  optimal  water  filling  and 
optimal  subspace  tracking  are  generated  for  comparison. 

11.  MIMO  Capacity  Considerations 


A.  MIMO  Capacity  for  Blind  Transmission 

The  MIMO  system  will  have  NT  transmission  antennas  and  NR 
receive  antennas,  where  it  will  be  assumed  that  Nj>Nr.  We 
consider  first  blind  transmission,  where  the  channel  input  is  a 
NTx  I  vector  t,  the  channel  output  is  the  N#x  1  vector  r,  the 
channel  gain  is  a  NRxNT  matrix  H,  and  the  noise  is  a  zero  mean 
N#x  1  complex  gaussian  vector  n  with  autocorrelation  2a2!.  The 
total  transmitted  power  is  constrained  to  f*r)=E( t^t). 

r  =  Ht  +  n  (1) 

A  coded  transmission  vector  t  will  be  uneorrelated  and  the 
total  transmission  power  is  P^\  so  that 
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Nr 

The  channel  capacity  for  this  system  is  [5] 
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where  |.|  and  (.)w  denote  the  matrix  determinant  and  conjugate 
transpose  respectively. 

B.  MIMO  Capacity  for  Subspace  Tracking  Transmission 


The  proof  of  (3)  through  the  singular  value  decomposition 
(SVD)  of  H  [12]  is  informative  with  regard  to  the  physical 
nature  of  the  capacity  through  the  existence  of  parallel  channels 
(eigenmodes)  and  the  benefits  of  tracking  those  modes. 

The  SVD  of  H  with  magnitude  sorted  singular  values  A*,/2 
and  unitary  matrices  U  and  V  is 


II  =  U  A'  2  V 

N**Nr  NkxN,  N'XNr  N,xN, 


(4) 


Then  the  channel  formulation  (1)  can  be  cast  into  an 
equivalent  form  with  r  ,  t  and  n  . 


(even,  odd)  slot 


accumulate 
and  dump  fj 

V - -  even 


Rx  modem 


.  W  ^  W  ,y 

even  odd 

HT»Hsn- 


data  - 


coding, 

interleaving, 

demultiplexing 


tralftt 


trqfjk- 
JVr*'v.m  4 


weight 

adaptation 


feedback 

— 


pilot  1  “ odd 

ixNm.  (even,  odd)  n^xn^ 


sign(.) 


Figure  1:  Diagram  of  the  system  with  the  gradient  algorithm 


r  =  U"r 


=  A,/2V"t  +  U"n  (5) 

=  A,/2T  +  n 

Since  V  and  U  are  an  unitary  matrices,  T  and  n  have  the 
same  equidiagonal  second  moments  as  their  source  vectors  t 
and  n,  and  the  independent  channels  from  t  to  r  provide  the 
capacity  “multiplexing  gain”. 


mm(N..NT  )-l 

'  =  Zk,S: 

*=0 


1+- 


2Nr(J2 


(6) 


Equation  (6)  directly  yields  (3).  From  the  perspective  of  the 
transmitter,  these  independent  channels  are  the  eigenmodes  of 
the  NrxNr  squared  gain  matrix  R. 


R  =  H"H  =  VAV"  (7) 

An  “informed”  transmitter,  which  knows  the  realization  of  II, 
can  attain  better  performance  than  that  described  above, 
optimizing  power  and  rate  allocation  to  the  eigenmodes  using 
“water  filling”  [4][  1 2].  This  requires  accurate  knowledge  of  the 
matrix  H.  A  simpler  approach  becomes  apparent  from 
considering  (5)  and  (6)  when  Nj>Nr.  Since  the  rank  of  R  is  the 
minimum  of  NR  and  NT,  there  are  null  spaces  in  R,  and  the  blind 
transmitter  is  transmitting  power  into  those  null  spaces;  none  of 
this  power  reaches  the  receiver.  Transmitting  only  into  the  non¬ 
zero  eigenmodes,  the  autocorrelation  of  the  modulation  vector  t 
becomes 
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where  (A*  >  0)  represents  the  numerical  value  of  the  boolean:  0 
if  false,  1  if  true. 

Applying  (5)  and  (6)  with  this  modified  modulation  scheme 
with  Nt>Nr,  wc  find 
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Hence,  a  capacity  improvement  of  10  logio(AVAW  dB  arises 
from  this  multi-mode  tracking  without  full  water  filling. 
The  object  of  the  algorithm  presented  in  this  paper  is  to  track 
those  non-zero  modes,  i.c.  the  subspace  orthogonal  to  the 
nullspace  of  R. 


111.  Algorithm  Description 


A.  Algorithm  Operation 

The  algorithm  goal  is  to  use  feedback  from  the  receiver  to 
assist  the  transmitter  in  tracking  the  dominant  modes  of  the 
channel  matrix  and  to  accomplish  transmission  according  to  (8). 
This  is  accomplished  first  by  defining  a  code  stream  vector  s  of 
dimension  NSrcx l  •  A jstc  *s  less  than  or  equal  to  the  overall  rank 
of  H,  as  determined  by  some  combination  of  capacity 
requirements,  number  of  transmit  and  receive  antennas,  and 
perhaps  measurement  by  the  receiver  determining  the  channel’s 
usable  rank,  as  this  might  be  less  than  m\x\{NT,NR)  in  many 
environments.  The  code  stream  s  is  then  mapped  to  the 
transmission  antennas  by  a  set  of  NSTC  transmission  weight 
vectors  contained  in  the  NtxNStc  matrix  W 

The  desired  matrix  W  is  clearly  defined  from  (8)  as  a  matrix 
with  a  column  span  occupying  the  subspace  given  by  the 
principal  vectors  of  V,  with  VVHW=I.  Mechanisms  previously 
proposed  for  tracking  single  mode  transmit  weights  (i.c.  M1SO 
systems)  can  be  extended  to  the  multi-mode  tracking  case,  such 
as  multiple  vector  code  book  selection  extrapolated  from  [8]. 
The  flexibility  and  performance  of  the  gradient  algorithm 
considered  in  [1][2]  make  it  appealing  as  a  source  for 
generalization  to  multi-mode  tracking,  and  this  is  the  approach 
considered  here. 


The  system  incorporates  pilot  sequence  transmissions  with 
each  parallel  coded  traffic  transmission,  shown  in  Figure  1 .  The 
weight  set  applied  to  the  pilot  is  even  and  odd  time  multiplexed 
between  perturbed  matrices  so  that  the  receiver  can  generate  a 
channel  estimate  for  demodulation  and  at  the  same  time 
generate  a  single  feedback  bit  selecting  the  preferred  perturbed 
pilot  weight  matrix.  Considering  sampling  at  the  modulation 
symbol  (or  chip)  rate  with  Nyquist  filtering  the  transmission  t  is 


(10) 


where  Afsk)l  is  the  number  of  modulation  samples  per 
perturbation  slot  and  is  the  number  of  perturbation  slots 

per  measurement/feedback  interval.  With  a  perturbation 
parameter  j3|  and  a  perturbation  matrix  P  the  cven/odd  time 
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With  frequency  flat  fading,  perfect  timing  recovery  and 
matched  Nyquist  receive  filtering  with  noise  n(/‘)  the  received 
signal  is 

r(/)=Ht(/)+n(») 

>(r) 


(t)  j| 

traffic  traffic 


/  (»)+**(/) 
(14) 

where  II  denotes  the  composite  weight  matrix  and  channel  as 
seen  by  the  receiver.  As  suggested  in  [l],  the  receiver  can 
simply  extract  an  estimate  of  the  channel  from 

estimates  of  h  .Xk)  andH„<w(A')-  *n  addition,  once  Per 

measurement  period,  indexed  k,  the  receiver  generates  feedback 
selecting  which  of  the  two  weight  matrices  provided  the  larger 
total  received  power  using  the  Frobcnius  norm. 

m2  ||  *  || 2  >\ 


d(k)=  j/gnj 


(15) 


Upon  receiving  this  feedback,  the  transmitter  can  update  the 
weight  matrix  to  the  orthonormal i zed  version  of  the  receiver 
preferred  matrix  by  setting  in  (16),  or  using  an  update 

size  pj  distinct  from  the  measurement  perturbation  Including 
these  two  parameters  allows  the  measurement  and  update  to  be 
optimized  separately.  A  Gram-Schmidt  orthogonal ization  is 
then  used,  denoted  Q{.)  from  the  QR  decomposition.  The 
transmitter  update  is  then 

a  + 1  )  =  2(W4o, ,(/:)+/); -d(k)P(k))  (16) 


B.  Convergence  Performance 

The  inverse  cost  function  of  the  adaptive  system  is  the  total 
received  power,  denoted  J. 

J(k)m  =  tr(\V  "  (k  )R\V  (k  ))  (17) 

It  is  shown  in  [14]  that  the  maximization  of  the  quantity  (17) 
accomplishes  the  desired  subspacc  tracking,  and  the  gradient  of 
Jis 

Vwj{k)=2R\V{k)  (18) 


Extending  a  result  from  [3]  (Append.  A),  if  P  is  comprised  of 
i.i.d.  random  complex  gaussians  with  variance  twice  unity,  the 
expected  value  of  the  weight  change  prior  to  orthononnal ization 
is  the  scaled  normalized  gradient  of  J  with  respect  to  W.  Hence, 
assuming  that  /},  is  small  enough  for  1st  order  approximation  of 
the  result,  neglecting  estimation  error  in  the  receiver,  and 
assuming  reliable  feedback,  the  weight  matrix  update  is 
\\(k  +  I )  =  Q(W  (£  + 1 )) 


=  Q 


RW(*) 


+  P2  E(*) 


(19) 


where  the  prime  represents  the  update  just  prior  to 
orthonormalization  and  E  is  a  zero  mean  error  matrix.  E  has 


some  autocorrelation,  due  to  the  normalized  gradient,  which  is 
extracted  from  t/^P  to  leave  E.  The  eigenmodal  representation 
in  the  update  prior  to  orthononnal  ization  is  then  a  diagonal 
modification  plus  noise  from  E. 


V"W(*  +  l)  = 


V"\\(k)+  P2V"E(k) 


(20) 

As  discussed  in  [14],  a  gradient  update  with  the  form  of  (20) 
will  cause  the  weight  matrix  to  converge  in  expected  value  to 
the  principal  subspaces  of  R.  Considering  that  the  direction  of 
the  first  column  of  \V'  is  unchanged  by  the  Gram-Schmidt 
procedure,  it  is  clear  from  the  principle  of  matrix  power 
iteration  that  this  column  of  \V  will  track  towards  the  principal 
eigenvector  of  R  the  second  column  of  \V  will  track  towards 
the  second  principal  eigenvector,  etc. 


IV.  Simulation  Results 


A.  Simulation  Environment 


The  algorithm  is  simulated  as  described  above  with 
NStc=Nr=2  and  both  Ay=4  and  Nf=  8.  In  all  cases  pi=0.005, 
small  enough  to  ensure  1st  order  gradient  extraction  without  2nd 
order  effects  in  the  receiver  measurement.  Channel  estimation  at 
the  receiver  was  considered  to  be  perfect  for  purposes  of 
generating  the  feedback  and  capacity  calculations,  a  not 
unreasonable  assumption  when  the  data  rate  is  much  larger  than 
the  channel  fading  rate,  which  allows  for  a  relatively  small  pilot 
transmission  power.  The  feedback  is  received  without  errors, 
and  p2  was  varied  to  find  its  best  value.  The  channel  model  is 
independent  Raleigh  flat  fading  with  time  correlation  given  by 
Jakes  model  and  a  doppler  frequency  of  5Hz. 

Two  cost  metrics  were  evaluated  through  the  simulation- 
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where  J{k)  is  the  time  varying  value  of  (17)  and  J0{),  (k)  is  the 
time  varying  value  of  (17)  for  perfect  subspacc  tracking.  In 
addition,  mean  capacity  values  in  units  of  bits/sccond/Hertz 
were  evaluated  according  to 
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These  capacities  were  evaluated  for  several  conditions  for 
Ml  MO  channels  with  both  8  and  4  transmit  antennas: 


SISO  AWGN:  S1SO  system,  Nf=NR=  1 ,  with  no  fading 
(AWGN  ehannel,  baseline  reference) 

SISO:  Nf=NR=\ 

SI  MO  Nf=  I ,  Nr=2 


M1MO  WF:  perfect  water  filling 

M1MOOST  optimal  subspacc  tracking  (error  free 

tracking  of  the  transmission  eigenmodcs) 


M1MO  Bid 
M1MO  GA: 
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subspaces 

gradient  algorithm  subspace  tracking 
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cost  functions.  NT*4 
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and  ft  vs  adaptation  ft;  various  feedback  rates  “FBR”;  A/=4,  NR= 2 


Figure  3:  Capacity  vs.  energy  per  Nyquist  sample,  At=4,  NR= 2. 
See  key  in  section  IV-A. . 


section  IV-A.  . 


B.  Discussion 

The  key  capacity  results  are  given  in  Figure  3,  Figure  4, 
Figure  6,  and  Figure  7,  showing  the  gains  available  from  the  use 
of  space  time  coding  in  the  MIMO  environment  and  the 
tradeoffs  associated  with  the  selection  of  the  strategy.  The  x- 
axis  energy  per  bit  or  energy  per  Nyquist  symbol  are  shown  for 
a  total  transmit  power  and  mean  single  channel  gain  \h\2t  so  that 
the  benefit  of  directing  the  transmission  power  toward  the 
receiver  is  visible 

h2=>S7  (24) 

Consider  the  capacity  plots  as  the  system  approaches 
infinitesimal  data  rate  in  “power  limited”  operation  in  Figure  4 


and  ft  vs  adaptation  ft;  various  feedback  rates  “FBR”,  Nf=  8,  NR= 2 


Figure  6:  Capacity  vs.  energy  per  Nyquist  sample  time,  Nj=R, 
Nr~2.  See  key  in  section  IV-A.  . 


section  IV-A.  . 


and  Figure  7.  The  reference  AWGN  SISO  system  asymptote  is 
the  well  known  -I.6dB  EftNo  limit.  The  Ixl  SISO  system  in 
fading  approaches  the  same  limit,  as  the  infinitesimal  data  rate 
gives  infinite  time  diversity  to  each  transmission  symbol;  for 
higher  data  rates  we  see  the  performance  degradation  of  the 
SISO  system  due  to  the  fading  channel.  The  required  E*/N0  for 
both  1x2  SI  MO  and  Nrx  2  blind  MIMO  systems  approach  the 
same  asymptote  for  infinitesimal  data  rate:  -4.6dB,  representing 
a  3dB  performance  enhancement  relative  to  the  AWGN 
baseline  due  to  the  2  receive  antennas.  It  is  interesting  to  note 
that  in  this  limit  the  “multiplexing  gain”  afforded  to  the  MIMO 
system  by  the  multiple  transmit  antennas  does  not  afford  any 
performance  improvement  with  blind  transmission;  one  might 


as  well  transmit  with  only  1  antenna.  The  optimal  Nfx2 
subspace  tracking  M1MO  systems  provide  an  additional 
performance  gain  of  1 0  1ogj0(A^7/A^)  dB  relative  to  the  1x2 
SIMO  or  Nfxl  blind  M1MO  systems,  for  gains  of  6dB  and  9dB 
over  the  AWGN  reference  for  Nf= 4  and  Nf=  8  respectively. 
Finally,  the  perfect  water  filling  system  can  squeeze  out  1.95dB 
for  4x2  M1MO  or  1.41dB  for  8x2  MIMO  beyond  what  the 
optimal  subspace  tracking  implementation  gives. 

In  Figure  3  and  Figure  6  the  capacities  as  a  function  of 
transmission  power  are  shown.  In  the  “bandwidth  limited” 
condition  the  performance  of  all  of  the  MIMO  algorithms 
provide  2bit/3dB  of  capacity  improvement  as  the  power  is 
increased,  as  is  expected  for  the  two  mode  MIMO  environment, 
while  the  SIMO  and  SISO  algorithms  show  lbit/3dB  with  only 
one  transmission  mode.  In  this  region  the  optimal  subspace 
tracking  algorithm  provides  the  same  performance  as  perfect 
water  filling,  and  continues  to  give  a  10  \og\0(NjJNR)  dB 
performance  gain  over  blind  MIMO  transmission. 

Together,  the  capacity  plots  show  the  gains  available  by 
subspace  tracking.  In  order  to  obtain  substantial  gains  from  a 
MIMO  system  operating  in  the  power  limited  portion  of  the 
capacity  curve  where  Nr<Nt  some  form  of  transmission 
adaptation  is  clearly  required,  as  the  blind  space  time  coding 
transmission  does  not  offer  substantial  gain  in  this  operating 
region.  Since  many  practical  systems  will  be  interference 
limited,  and  additional  power  transmitted  for  each  information 
bit  transferred  is  interference  to  other  users,  there  is  strong 
motivation  for  operating  in  or  near  the  power  limited  rather  than 
the  bandwidth  limited  portion  of  the  capacity  curve.  Hence,  we 
see  the  motivation  for  adopting  some  form  of  transmission 
adaptation  scheme,  with  subspace  tracking  forming  perhaps  the 
simplest  general  class  of  appropriate  adaptation. 

The  simulation  results  of  Figure  2  and  Figure  5  show  the 
performance  of  the  proposed  gradient  algorithm  for  various 
parameters.  There  is  a  strong  dependency  on  both  the  selection 
of  ft  and  of  the  feedback  rate  Increasing  the  feedback  rate 
allows  for  faster  adaptation  with  a  smaller  ft  and  significantly 
improves  the  performance  of  the  gradient  subspacc  tracking 
algorithm.  For  the  simulated  fading  rate  of  5Hz,  it  is  clear  that 
the  receive  unit  to  transmit  unit  sign  feedback  bit  rate  must  be  at 
least  on  the  order  of  I  kHz,  and  approaching  10kHz  provides 
near  optimum  performance  for  the  4x2  MIMO  case.  The 
realized  mean  capacity  for  the  gradient  algorithm  with  the  best 
values  of  ft  for  arc  also  shown  in  Figure  3,  Figure  4,  Figure  6, 
and  Figure  7,  with  feedback  rates  of  8kbps  and  2kbps 
and  I  kbps  (Nf= 4).  These  show  that  the  loss  captured  in  the 
performance  metrics  J0  and  J\  are  reasonable  approximations  of 
the  actual  loss  of  capacity  relative  to  perfect  subspace  tracking. 

Obtaining  reasonably  high  feedback  bit  rates,  on  the  order  of 
lOOOx  the  fading  rate,  appears  to  be  a  requirement  for  good 
operation  of  the  gradient  feedback  algorithm.  This  is  not  likely 
to  be  a  large  cost  in  overall  bandwidth  resource,  since  the  data 
rates  on  the  forward  link  would  likely  be  far  larger,  but  it  also 
implies  a  small  channel  estimation  time  for  each  decision, 
which  is  important  when  imperfect  channel  estimation  problems 
are  considered  While  the  algorithm  performs  largely  as 
expected  and  desired,  the  practical  realization  of  a  system  of  the 
type  proposed  in  this  paper  requires  further  research.  The  gains 
which  are  possible  from  the  algorithm  are  clearly  substantial. 


V.  Conclusion 

The  desirability  of  subspace  tracking  algorithms  for  low  rank 
MIMO  systems  has  been  identified  and  verified  through 
analysis  and  simulation.  For  systems  with  more  transmit  than 
receive  antennas  the  gain  available  from  multi-mode  tracking  is 
101ogio(AVAW  dB  over  the  application  of  blind,  non-adaptive, 
space  time  coding  techniques.  It  has  been  shown  that  blind 
space  time  coding  techniques  give  very  little  gain  if  the  system 
is  operating  in  the  “power  limited”  region  of  the  capacity  curve, 
which  is  a  desirable  operation  region  from  the  standpoint  of 
minimizing  interference.  Finally,  a  specific  gradient  algorithm 
incorporating  feedback  from  the  receiver  to  track  transmission 
weights  to  the  principal  channel  transfer  modes  has  been 
presented  and  shown  to  be  capable  of  providing  performance 
near  that  of  perfect  subspace  tracking. 
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